Assessing the cognitive decline of people in the spectrum of AD by monitoring their activities of daily living in an IoT-enabled smart home environment: a cross-sectional pilot study.

Introduction: Assessing functional decline related to activities of daily living (ADLs) is deemed significant for the early diagnosis of dementia. As current assessment methods for ADLs often lack the ability to capture subtle changes, technology-based approaches are perceived as advantageous. Specifically, digital biomarkers are emerging, offering a promising avenue for research, as they allow unobtrusive and objective monitoring. Methods: A study was conducted with the involvement of 36 participants assigned to three known groups (Healthy Controls, participants with Subjective Cognitive Decline and participants with Mild Cognitive Impairment). Participants visited the CERTH-IT Smart Home, an environment that simulates a fully functional residence, and were asked to follow a protocol describing different ADL Tasks (namely Task 1 - Meal, Task 2 - Beverage and Task 3 - Snack Preparation). By utilizing data from fixed in-home sensors installed in the Smart Home, the identification of the performed Tasks and their derived features was explored through the developed CARL platform. Furthermore, differences between groups were investigated. Finally, overall feasibility and study satisfaction were evaluated. Results: The composition of the ADLs was attainable, and differentiation among the HC group compared to the SCD and the MCI groups considering the feature "Activity Duration" in Task 1 - Meal Preparation was possible, while no difference could be noted between the SCD and the MCI groups. Discussion: This ecologically valid study was determined as feasible, with participants expressing positive feedback. The findings additionally reinforce the interest and need to include people in preclinical stages of dementia in research to further evolve and develop clinically relevant digital biomarkers.

NeuMa - the absolute Neuromarketing dataset en route to an holistic understanding of consumer behaviour.

Neuromarketing is a continuously evolving field that utilises neuroimaging technologies to explore consumers' behavioural responses to specific marketing-related stimulation, and furthermore introduces novel marketing tools that could complement the traditional ones like questionnaires. In this context, the present paper introduces a multimodal Neuromarketing dataset that encompasses the data from 42 individuals who participated in an advertising brochure-browsing scenario. In more detail, participants were exposed to a series of supermarket brochures (containing various products) and instructed to select the products they intended to buy. The data collected for each individual executing this protocol included: (i) encephalographic (EEG) recordings, (ii) eye tracking (ET) recordings, (iii) questionnaire responses (demographic, profiling and product related questions), and (iv) computer mouse data. NeuMa dataset has both dynamic and multimodal nature and, due to the narrow availability of open relevant datasets, provides new and unique opportunities for researchers in the field to attempt a more holistic approach to neuromarketing.

Eliciting brain waves of people with cognitive impairment during meditation exercises using portable electroencephalography in a smart-home environment: a pilot study.

Objectives: Meditation imparts relaxation and constitutes an important non-pharmacological intervention for people with cognitive impairment. Moreover, EEG has been widely used as a tool for detecting brain changes even at the early stages of Alzheimer's Disease (AD). The current study investigates the effect of meditation practices on the human brain across the AD spectrum by using a novel portable EEG headband in a smart-home environment. Methods: Forty (40) people (13 Healthy Controls-HC, 14 with Subjective Cognitive Decline-SCD and 13 with Mild Cognitive Impairment-MCI) participated practicing Mindfulness Based Stress Reduction (Session 2-MBSR) and a novel adaptation of the Kirtan Kriya meditation to the Greek culture setting (Session 3-KK), while a Resting State (RS) condition was undertaken at baseline and follow-up (Session 1-RS Baseline and Session 4-RS Follow-Up). The signals were recorded by using the Muse EEG device and brain waves were computed (alpha, theta, gamma, and beta). Results: Analysis was conducted on four-electrodes (AF7, AF8, TP9, and TP10). Statistical analysis included the Kruskal-Wallis (KW) nonparametric analysis of variance. The results revealed that both states of MBSR and KK lead to a marked difference in the brain's activation patterns across people at different cognitive states. Wilcoxon Signed-ranks test indicated for HC that theta waves at TP9, TP10 and AF7, AF8 in Session 3-KK were statistically significantly reduced compared to Session 1-RS Z = -2.271, p = 0.023, Z = -3.110, p = 0.002 and Z = -2.341, p = 0.019, Z = -2.132, p = 0.033, respectively. Conclusion: The results showed the potential of the parameters used between the various groups (HC, SCD, and MCI) as well as between the two meditation sessions (MBSR and KK) in discriminating early cognitive decline and brain alterations in a smart-home environment without medical support.

Human Recognition Using Deep Neural Networks and Spatial Patterns of SSVEP Signals.

Brain biometrics have received increasing attention from the scientific community due to their unique properties compared to traditional biometric methods. Many studies have shown that EEG features are distinct across individuals. In this study, we propose a novel approach by considering spatial patterns of the brain's responses due to visual stimulation at specific frequencies. More specifically, we propose, for the identification of the individuals, to combine common spatial patterns with specialized deep-learning neural networks. The adoption of common spatial patterns gives us the ability to design personalized spatial filters. In addition, with the help of deep neural networks, the spatial patterns are mapped into new (deep) representations where the discrimination between individuals is performed with a high correct recognition rate. We conducted a comprehensive comparison between the performance of the proposed method and several classical methods on two steady-state visual evoked potential datasets consisting of thirty-five and eleven subjects, respectively. Furthermore, our analysis includes a large number of flickering frequencies in the steady-state visual evoked potential experiment. Experiments on these two steady-state visual evoked potential datasets showed the usefulness of our approach in terms of person identification and usability. The proposed method achieved an averaged correct recognition rate of 99% over a large number of frequencies for the visual stimulus.

A Sparse Representation Classification Scheme for the Recognition of Affective and Cognitive Brain Processes in Neuromarketing.

In this work, we propose a novel framework to recognize the cognitive and affective processes of the brain during neuromarketing-based stimuli using EEG signals. The most crucial component of our approach is the proposed classification algorithm that is based on a sparse representation classification scheme. The basic assumption of our approach is that EEG features from a cognitive or affective process lie on a linear subspace. Hence, a test brain signal can be represented as a linear (or weighted) combination of brain signals from all classes in the training set. The class membership of the brain signals is determined by adopting the Sparse Bayesian Framework with graph-based priors over the weights of linear combination. Furthermore, the classification rule is constructed by using the residuals of linear combination. The experiments on a publicly available neuromarketing EEG dataset demonstrate the usefulness of our approach. For the two classification tasks offered by the employed dataset, namely affective state recognition and cognitive state recognition, the proposed classification scheme manages to achieve a higher classification accuracy compared to the baseline and state-of-the art methods (more than 8% improvement in classification accuracy).

Revisiting Riemannian geometry-based EEG decoding through approximate joint diagonalization.

Objective.The wider adoption of Riemannian geometry in electroencephalography (EEG) processing is hindered by two factors: (a) it involves the manipulation of complex mathematical formulations and, (b) it leads to computationally demanding tasks. The main scope of this work is to simplify particular notions of Riemannian geometry and provide an efficient and comprehensible scheme for neuroscientific explorations.Approach.To overcome the aforementioned shortcomings, we exploit the concept of approximate joint diagonalization in order to reconstruct the spatial covariance matrices assuming the existence of (and identifying) a common eigenspace in which the application of Riemannian geometry is significantly simplified.Main results.The employed reconstruction process abides to physiologically plausible assumptions, reduces the computational complexity in Riemannian geometry schemes and bridges the gap between rigorous mathematical procedures and computational neuroscience. Our approach is both formally established and experimentally validated by employing real and synthetic EEG data.Significance.The implications of the introduced reconstruction process are highlighted by reformulating and re-introducing two signal processing methodologies, namely the 'Symmetric Positive Definite (SPD) Matrix Quantization' and the 'Coding over SPD Atoms'. The presented approach paves the way for robust and efficient neuroscientific explorations that exploit Riemannian geometry schemes.

An Adaptive Task-Related Component Analysis Method for SSVEP Recognition.

Steady-State Visual Evoked Potential (SSVEP) recognition methods use a subject's calibration data to differentiate between brain responses, hence, providing the SSVEP-based brain-computer interfaces (BCIs) with high performance. However, they require sufficient calibration EEG trials to achieve that. This study develops a new method to learn from limited calibration EEG trials, and it proposes and evaluates a novel adaptive data-driven spatial filtering approach for enhancing SSVEP detection. The spatial filter learned from each stimulus utilizes temporal information from the corresponding EEG trials. To introduce the temporal information into the overall procedure, a multitask learning approach, based on the Bayesian framework, is adopted. The performance of the proposed method was evaluated into two publicly available benchmark datasets, and the results demonstrated that our method outperformed competing methods by a significant margin.

RNeuMark: A Riemannian EEG Analysis Framework for Neuromarketing.

Neuromarketing exploits neuroimaging techniques so as to reinforce the predictive power of conventional marketing tools, like questionnaires and focus groups. Electroencephalography (EEG) is the most commonly encountered neuroimaging technique due to its non-invasiveness, low-cost, and its very recent embedding in wearable devices. The transcription of brainwave patterns to consumer attitude is supported by various signal descriptors, while the quest for profitable novel ways is still an open research question. Here, we suggest the use of sample covariance matrices as alternative descriptors, that encapsulate the coordinated neural activity from distinct brain areas, and the adoption of Riemannian geometry for their handling. We first establish the suitability of Riemannian approach for neuromarketing-related problems and then suggest a relevant decoding scheme for predicting consumers' choices (e.g., willing to buy or not a specific product). Since the decision-making process involves the concurrent interaction of various cognitive processes and consequently of distinct brain rhythms, the proposed decoder takes the form of an ensemble classifier that builds upon a multi-view perspective, with each view dedicated to a specific frequency band. Adopting a standard machine learning procedure, and using a set of trials (training data) in conjunction with the associated behavior labels ("buy"/ "not buy"), we train a battery of classifiers accordingly. Each classifier is designed to operate in the space recovered from the inter-trial distances of SCMs and to cast a rhythm-depended decision that is eventually combined with the predictions of the rest ones. The demonstration and evaluation of the proposed approach are performed in 2 neuromarketing-related datasets of different nature. The first is employed to showcase the potential of the suggested descriptor, while the second to showcase the decoder's superiority against popular alternatives in the field.

Exploring the Connection of Brain Computer Interfaces and Multimedia Use With the Social Integration of People With Various Motor Disabilities: A Questionnaire-Based Usability Study.

We have designed a platform to aid people with motor disabilities to be part of digital environments, in order to create digitally and socially inclusive activities that promote their quality of life. To evaluate in depth the impact of the platform on social inclusion indicators across patients with various motor disabilities, we constructed a questionnaire in which the following indicators were assessed: (i) Well Being, (ii) Empowerment, (iii) Participation, (iv) Social Capital, (v) Education, and (vi) Employment. In total 30 participants (10 with Neuromuscular Disorders-NMD, 10 with Spinal Cord Injury-SCI, and 10 with Parkinson's Disease-PD) used the platform for ~1 month, and its impact on social inclusion indicators was measured before and after the usage. Moreover, monitoring mechanisms were used to track computer usage as well as an online social activity. Finally, testimonials and experimenter input were collected to enrich the study with qualitative understanding. All participants were favorable to use the suggested platform, while they would prefer it for longer periods of time in order to become "re-awakened" to possibilities of expanded connection and inclusion, while it became clear that the platform has to offer them further the option to use it in a reclining position. The present study has clearly shown that the challenge of social inclusion cannot be tackled solely with technology and it needs to integrate persuasive design elements that foster experimentation and discovery.

Exploring Network Properties Across Preclinical Stages of Alzheimer's Disease Using a Visual Short-Term Memory and Attention Task with High-Density Electroencephalography: A Brain-Connectome Neurophysiological Study.

BACKGROUND: Visual short-term memory (VSTMT) and visual attention (VAT) exhibit decline in the Alzheimer's disease (AD) continuum; however, network disruption in preclinical stages is scarcely explored. OBJECTIVE: To advance our knowledge about brain networks in AD and discover connectivity alterations during VSTMT and VAT. METHODS: Twelve participants with AD, 23 with mild cognitive impairment (MCI), 17 with subjective cognitive decline (SCD), and 21 healthy controls (HC) were examined using a neuropsychological battery at baseline and follow-up (three years). At baseline, the subjects were examined using high density electroencephalography while performing a VSTMT and VAT. For exploring network organization, we constructed weighted undirected networks and examined clustering coefficient, strength, and betweenness centrality from occipito-parietal regions. RESULTS: One-way ANOVA and pair-wise t-test comparisons showed statistically significant differences in HC compared to SCD (t (36) = 2.43, p = 0.026), MCI (t (42) = 2.34, p = 0.024), and AD group (t (31) = 3.58, p = 0.001) in Clustering Coefficient. Also with regards to Strength, higher values for HC compared to SCD (t (36) = 2.45, p = 0.019), MCI (t (42) = 2.41, p = 0.020), and AD group (t (31) = 3.58, p = 0.001) were found. Follow-up neuropsychological assessment revealed converge of 65% of the SCD group to MCI. Moreover, SCD who were converted to MCI showed significant lower values in all network metrics compared to the SCD that remained stable. CONCLUSION: The present findings reveal that SCD exhibits network disorganization during visual encoding and retrieval with intermediate values between MCI and HC.

Reconstructing EOG From EEG Timeseries: A Spatial Filtering Approach.

Unobtrusive mental state monitoring based on neurosphysiological signals has seen thriving developments over the past decade, with a wide area of applications, from rehabilitation to neuroergonomics and neuromarketing. Particularly, electroencephalography (EEG) and electrooculography (EOG) have been popular techniques to obtain cognitive-relevant biosignals. However, current wearable systems may still pose practical inconvenience, motivating further interest to integrate EOG+EEG recording into streamlined frontal-only sensor montages with sufficient signal fidelity. We propose, here, a spatial filtering approach to reliably extract EOG signals from a reduced set of frontal EEG electrodes, placed on non-hair-bearing (NHB) areas. Within a common signal analytic framework, two distinct schemes are examined. The one is based on standard linear least squares (LLS) and the other on Least Absolute Shrinkage and Selection Operator (LASSO). Both schemes are data-driven techniques, require a small amount of training data, and lead to reliable estimators of EOG activity from EEG signals. The LASSO-based technique, in addition, provides guidelines that generalize well across subjects. Using experimental data, we provide some empirical evidence that our estimators can replace the actual EOG signals in algorithmic pipelines that automatically detect oculographic events, like blinks and saccades.

Unlocking the Subconscious Consumer Bias: A Survey on the Past, Present, and Future of Hybrid EEG Schemes in Neuromarketing.

Fueled by early success stories, the neuromarketing domain advanced rapidly during the last 10 years. As exciting new techniques were being adapted from medical research to the commercial domain, many neuroscientists and marketing practitioners have taken the chance to exploit them so as to uncover the answers of the most important marketing questions. Among the available neuroimaging technologies, electroencephalography (EEG) stands out as the less invasive and most affordable method. While not equally precise as other neuroimaging technologies in terms of spatial resolution, it can capture brain activity almost at the speed of cognition. Hence, EEG constitutes a favorable candidate for recording and subsequently decoding the consumers' brain activity. However, despite its wide use in neuromarketing, it cannot provide the complete picture alone. In order to overcome the limitations imposed by a single monitoring method, researchers focus on more holistic approaches. The exploitation of hybrid EEG schemes (e.g., combining EEG with eye-tracking, electrodermal activity, heart rate, and/or other) is ever growing and will hopefully allow neuromarketing to uncover consumers' behavior. Our survey revolves around last-decade hybrid neuromarketing schemes that involve EEG as the dominant modality. Beyond covering the relevant literature and state-of-the-art findings, we also provide future directions on the field, present the limitations that accompany each of the commonly employed monitoring methods and briefly discuss the omni-present ethical scepticizm related to neuromarketing.

A Novel Bayesian Approach for EEG Source Localization.

We propose a new method for EEG source localization. An efficient solution to this problem requires choosing an appropriate regularization term in order to constraint the original problem. In our work, we adopt the Bayesian framework to place constraints; hence, the regularization term is closely connected to the prior distribution. More specifically, we propose a new sparse prior for the localization of EEG sources. The proposed prior distribution has sparse properties favoring focal EEG sources. In order to obtain an efficient algorithm, we use the variational Bayesian (VB) framework which provides us with a tractable iterative algorithm of closed-form equations. Additionally, we provide extensions of our method in cases where we observe group structures and spatially extended EEG sources. We have performed experiments using synthetic EEG data and real EEG data from three publicly available datasets. The real EEG data are produced due to the presentation of auditory and visual stimulus. We compare the proposed method with well-known approaches of EEG source localization and the results have shown that our method presents state-of-the-art performance, especially in cases where we expect few activated brain regions. The proposed method can effectively detect EEG sources in various circumstances. Overall, the proposed sparse prior for EEG source localization results in more accurate localization of EEG sources than state-of-the-art approaches.

A Novel Connectome-Based Electrophysiological Study of Subjective Cognitive Decline Related to Alzheimer's Disease by Using Resting-State High-Density EEG EGI GES 300.

Aim: To investigate for the first time the brain network in the Alzheimer's disease (AD) spectrum by implementing a high-density electroencephalography (HD-EEG - EGI GES 300) study with 256 channels in order to seek if the brain connectome can be effectively used to distinguish cognitive impairment in preclinical stages. Methods: Twenty participants with AD, 30 with mild cognitive impairment (MCI), 20 with subjective cognitive decline (SCD) and 22 healthy controls (HC) were examined with a detailed neuropsychological battery and 10 min resting state HD-EEG. We extracted correlation matrices by using Pearson correlation coefficients for each subject and constructed weighted undirected networks for calculating clustering coefficient (CC), strength (S) and betweenness centrality (BC) at global (256 electrodes) and local levels (29 parietal electrodes). Results: One-way ANOVA presented a statistically significant difference among the four groups at local level in CC [F (3, 88) = 4.76, p = 0.004] and S [F (3, 88) = 4.69, p = 0.004]. However, no statistically significant difference was found at a global level. According to the independent sample t-test, local CC was higher for HC [M (SD) = 0.79 (0.07)] compared with SCD [M (SD) = 0.72 (0.09)]; t (40) = 2.39, p = 0.02, MCI [M (SD) = 0.71 (0.09)]; t (50) = 0.41, p = 0.004 and AD [M (SD) = 0.68 (0.11)]; t (40) = 3.62, p = 0.001 as well, while BC showed an increase at a local level but a decrease at a global level as the disease progresses. These findings provide evidence that disruptions in brain networks in parietal organization may potentially represent a key factor in the ability to distinguish people at early stages of the AD continuum. Conclusions: The above findings reveal a dynamically disrupted network organization of preclinical stages, showing that SCD exhibits network disorganization withintermediate values between MCI and HC. Additionally, these pieces of evidence provide information on the usefulness of the 256 HD-EEG in network construction.

A Bayesian Multiple Kernel Learning Algorithm for SSVEP BCI Detection.

This paper deals with the classification of steady-state visual evoked potentials (SSVEP), which is a multiclass classification problem addressed in SSVEP-based brain-computer interfaces. In particular, our method named MultiLRM_MKL uses multiple linear regression models under a Sparse Bayesian Learning (SBL) framework to discriminate between the SSVEP classes. The regression coefficients of each model are learned using the Variational Bayesian (VB) framework and the kernel trick is adopted not only for reducing the computational cost of our method, but also for enabling the combination of different kernel spaces. We verify the effectiveness of our method in handling different kernel spaces by evaluating its performance with a new kernel based on canonical correlation analysis. In particular, we prove the benefit of combining multiple kernels by outperforming several state-of-the-art methods in two SSVEP datasets, reaching an information transfer rate of 93 b/min using only three channels from the occipital area ( Oz, O1, and O2).

Discrimination of SSVEP responses using a kernel based approach.

Brain Computer Interfaces based on Steady State Visual Evoked Potentials have gained increased attention due to their low training requirements and higher information transfer rates. In this work, a method based on sparse kernel machines is proposed for the discrimination of Steady State Visual Evoked Potentials responses. More specifically, a new kernel based on Partial Least Squares is introduced to describe the similarities between EEG trials, while the estimation of regression weights is performed using the Sparse Bayesian Learning framework. The experimental results obtained on two benchmarking datasets, have shown that the proposed method provides significantly better performance compared to state of the art approaches of the related literature.

Sparse Kernel Machines for motor imagery EEG classification.

Brain-computer interfaces (BCIs) make humancomputer interaction more natural, especially for people with neuro-muscular disabilities. Among various data acquisition modalities the electroencephalograms (EEG) occupy the most prominent place due to their non-invasiveness. In this work, a method based on sparse kernel machines is proposed for the classification of motor imagery (MI) EEG data. More specifically, a new sparse prior is proposed for the selection of the most important information and the estimation of model parameters is performed using the bayesian framework. The experimental results obtained on a benchmarking EEG dataset for MI, have shown that the proposed method compares favorably with state of the art approaches in BCI literature.

A multimodal dataset for authoring and editing multimedia content: The MAMEM project.

We present a dataset that combines multimodal biosignals and eye tracking information gathered under a human-computer interaction framework. The dataset was developed in the vein of the MAMEM project that aims to endow people with motor disabilities with the ability to edit and author multimedia content through mental commands and gaze activity. The dataset includes EEG, eye-tracking, and physiological (GSR and Heart rate) signals collected from 34 individuals (18 able-bodied and 16 motor-impaired). Data were collected during the interaction with specifically designed interface for web browsing and multimedia content manipulation and during imaginary movement tasks. The presented dataset will contribute towards the development and evaluation of modern human-computer interaction systems that would foster the integration of people with severe motor impairments back into society.

An adaptive regression mixture model for fMRI cluster analysis.

Functional magnetic resonance imaging (fMRI) has become one of the most important techniques for studying the human brain in action. A common problem in fMRI analysis is the detection of activated brain regions in response to an experimental task. In this work we propose a novel clustering approach for addressing this issue using an adaptive regression mixture model. The main contribution of our method is the employment of both spatial and sparse properties over the body of the mixture model. Thus, the clustering approach is converted into a maximum a posteriori estimation approach, where the expectation-maximization algorithm is applied for model training. Special care is also given to estimate the kernel scalar parameter per cluster of the design matrix by presenting a multi-kernel scheme. In addition an incremental training procedure is presented so as to make the approach independent on the initialization of the model parameters. The latter also allows us to introduce an efficient stopping criterion of the process for determining the optimum brain activation area. To assess the effectiveness of our method, we have conducted experiments with simulated and real fMRI data, where we have demonstrated its ability to produce improved performance and functional activation detection capabilities.

A sparse and spatially constrained generative regression model for fMRI data analysis.

In this study, we present an advanced Bayesian framework for the analysis of functional magnetic resonance imaging (fMRI) data that simultaneously employs both spatial and sparse properties. The basic building block of our method is the general linear regression model that constitutes a well-known probabilistic approach. By treating regression coefficients as random variables, we can apply an enhanced Gibbs distribution function that captures spatial constrains and at the same time allows sparse representation of fMRI time series. The proposed scheme is described as a maximum a posteriori approach, where the known expectation maximization algorithm is applied offering closed-form update equations for the model parameters. We have demonstrated that our method produces improved performance and functional activation detection capabilities in both simulated data and real applications.